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Collective Intelligence 


Pierre Lévy 15 a French philosopher introduced the 
collective intelligence concept in his book 
L'intelligence collective: Pour une anthropologie du 
cyberspace (1994). 


But, concept originated (in other forms) much earlier 


http://gutenberg.net.au/ebooks13/1303731h.html 


Wells describes his vision of the world brain: a new, free, 
synthetic, authoritative, permanent World Encyclopaedia 
that could help world citizens make the best use of universal 
information resources and make the best contribution to 
world peace. —Wikipedia 


POLITICS 


Aristotle: a feast to which many contribute is 
better than a dinner provided out of a single 
purse 
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Collective Intelligence 


LE CONTRRIRE DE LR 2 
BÊTISE INDIVIDUELLE *' 


L'INTELLIGENCE 
COLLECTIVE 
EST-ELLE... 


et 


Collective intelligence is the effect by which the aggregate results 
that are obtained by a diverse group of people will tend to be more 
accurate than any one person alone. 
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Collective Intelligence 


Building Smart Web 2.0 Applications 


Programming 


Collective intelligence as Collective 
"groups of individuals acting Intelligence 


collectively in an intelligent 
manner," E 


Individuals may be software 
agents and/or people (and/ 
or animals?) and the 
collective may consist of a 
mixture 


8 REI LLY 9 - Toby Segaran 
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Crowdsourcing 


Howe, Jeff. "The rise 
of crowdsourcing." 


Wired magazine 14.6 
(2006): 1-4. 


Brabham, Daren C. 
"Crowdsourcing as a 
model for problem 
solving: An 
introduction and 


cases." Convergence 
14.1 (2008): 75-90. 


NZISE TO SIGNAL 


Rob Cottingham 


I think you'll be 
delightfully surprised 
by the quality of my work 
on this assignment. 

I crowdsourced it. 


Crowd sourcing is the process by which 
work or knowledge is obtained from the 
public at large through a system of 
invitations and incentives 
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Swarm Intelligence - multi Agent Distributed Systems 
(Inspired by nature) 
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Swarm Intelligence - multi Agent Distributed Systems 
(inspired by nature) 
The emergent collective intelligence of groups of simple agents 


The key 15 that complex behaviour (problem solving) arises out 
of a composition of simple behaviours. 


These simple behaviours are usually homogeneous, but can be 
multi-role. 


Designing solutions to problems using swarm algorithms 1s 
very challenging. 


Question: how simple can the agent behaviour be?? 
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Cellular Automata 


John Conway's Game of Life 


Any live cell with fewer than two live neighbours dies, as if caused by underpopulation. 
Any live cell with two or three live neighbours lives on to the next generation. 

Any live cell with more than three live neighbours dies, as if by overpopulation. 

Any dead cell with exactly three live neighbours becomes a live cell, as if by reproduction. 


= ذم دن دک 


0 
R-Pentomino (1) R-Pentomino (2) R-Pentomino (3) R-Pentomino (4) 


Two Dimensions 
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Cellular Automata 


John Conway's Game of Life - Universal Turing Machine 
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https://youtu.be/My8AsV7bA94 
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Universality in elementary cellular automata 


Cellular Automata 


Distributed Donors Problem 


A group of donors wish to donate money to a charitable organisation. In 
the group there is a single treasurer who is responsible for collecting and 
counting all the donations. 


The following distributed process is used to collect and count donations - 


When a donor meets the treasurer, they give their donation to the 
treasurer and the treasurer updates the donation count. If a donor meets 
another donor, then the 2 donors combine their donations into a single 
donation and 1 of the donors takes responsibility for getting the 
combined donation to the treasurer; the other donor has no longer any 
role to play in the process. The process is finished when all donors, 
except the treasurer, have given their donation to someone else (ie the 
treasurer). 


We wish to implement a simulation of this process and check that on 
completion the treasurer has the sum of all the individual donations 


We also wish to check the complexity/performance of the distributed algorithm. 
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Distributed Donors Problem 
Write a Java Simulation of the DDP 
Randomly initialise the room with 100 donors 
Randomly appoint a single donor as the treasurer 
Each donor object should be a separate thread 
simulate one donor meeting another donor and exchanging their funds 


If the average time between meetings is 10 seconds, then how long -on 
average - will it take until all the money is with the treasurer 


Note: This is not really emergent behaviour, but ... 


Processes and Threads (in Java) 


Concurrency without parallelism Concurrency with parallelism 


Performance tuning technique number 106: Concurrency vs. Parallelism 


Copyright © Fasterj.com Limited 


Processes and Threads are the two fundamental units of 
execution in a concurrent program. 


Processes and Threads 
"In Java, concurrent programming is mostly thread-based. 


*Processing time for each core in a system 15 shared among processes and threads 
through an OS feature called time slicing. 


*Concurrency is possible even on simple systems, without multiple processors or 
execution cores. 


Process vs Threads 


Process (JVM) 


Each thread has its 
own stack memory 


Single heap per process 
shared by all the threads 


http://www.java-forums.org/blogs/thread/ 


ee 


Processes 


Self-contained execution environment. 

Independent set of basic run-time resources, such as memory space. 

A single application may be implemented by a set of cooperating processes. 
Most operating systems support /nter Process Communication (IPC) resources. 
IPC can also used for communication between processes on different systems. 


Most implementations of the JVM run as a single process. 


Threads 


Also known as lightweight processes. 
Creating a new thread requires fewer resources than creating a new process. 
Threads exist within a process — every process has at least one. 
Threads share the process's resources, including memory and open files. 
This has advantages and disadvantages ... can you think of them? 
Multithreaded execution 15 essential in Java: 

* every application has at least one thread 

"system" threads that do memory management, event/signal handling, etc. 


In programming, we start with just one thread, called the main thread. 


Any thread (including the main thread) can create new threads. 
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Threads in Java: some additional reading 


Fixing The Java Memory Model, William Pugh, 1999. 
The Problem with Threads, Edward Lee, 2006. 


Java Thread Programming, by Paul Hyde ISBN: 0672315858 
Sams 1999 


Concurrent Programming in Java™: Design, Principles and 
Patterns, Second Edition, By Doug Lea, ISBN: 0-201-31009-0 
Addison Wesley, 2001 
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Thread Example 


Download the code Threads.zip from the web site and import it into 
Eclipse 


Y [— Threads 
v (src 
Y fl examples 
> [J] SharedString.java 
TO DO 
» |J] SimpleThread.java 
Y fH tests 
b Fi SharingThreadsTest.java 
» |J) SimpleThreadTest.java 
> m JRE System Library [JavaSE- 1.8] 
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Thread Example 


public class ThreadExample { 


public static void main (String[] args) { 
System.out.println("Starting Thread main"); 
new SimpleThread("Addl", '1').start(); 
new SimpleThread("Add2", '2').start(); 


System.out.println("Finishing Thread main"); 


Thread Example - typical output 


ina 

DDD 

LR‏ ررك 

for threadAda2 
WE 

SETTE 

jb TEE 

tor threadAdd |: 


LO 
LO 
LO 
LO 
CO 
LO 
LO 


Starting Thread main 


extended 
extended 
extended 
extended 
extended 
extended 
extended 


Add2 
Add2 
Add2 
Addl 
Addl 
Add2 
Add2 


Finishing Thread main 


E EE 
EXE TG 
Sterne 
EI I 
SEEING 
SEEING 
OCENG 


No more increments left 
String Addl extended to 
String Addl extended to 
String Addl extended to 
No more increments left 


TSP: Advanced OO Programming - Threads 
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Thread Example - SimpleThread Code 


/* see - 


http://docs.oracle.com/javase/6/docs/api/java/lang/Thread.html 
*y 


class SimpleThread extends Thread { 
String stringofchars; 
char increment; 


public SimpleThread(String str, char inc) ( 
super (str); 
stringofchars = ""; 
increment = inc; 


} 
public void run() { 
tor (int i = 0; i > 5; i++) (d 


try { 
sleep((int) (Math. random() * 3000)); 
} catch (InterruptedException e) {} 
stringofchars = stringofchars + increment; 
System.out.println("String " + getName () + 


" extended to "+ stringofchars ); 
} 


System. 0112 . 7521212 ("No more increments left for 
thread" + getName () ) ; 


IllegalThreadStateException 


The runtime system throws an IllegalThreadStateException 
when you call a method on a thread and that thread's state does not allow 
for that method call. (See the state machine diagram in later slides) 


So, when you call a thread method that can throw an exception, you must 
either catch and handle the exception, or specify that the calling method 
throws the uncaught exception. 


The sleep method can also throw an InterruptedException, and so 
we needed a try/catch in the previous code: 


try { 
sleep((int)(Math.random() * 3000)); 


catch (InterruptedException e) 1j‏ م 


Sharing Thread Problem 


The previous example showed how two independent threads 
execute concurrently. 


Threads can also share data/objects and so their concurrent 
behaviours are inter-dependent. 


We wish to change the previous code so that the 2 threads update 
the same string of characters. 


We will do this using a SharedString class 


Sharing Thread Problem 


Your task is to code the class SharingThread 


v src 
Y H3 examples 
> [J] SharedString.java 


class SharedString { 


public SharedString() {str ="";} 4 D Sano Tsad javi m 
public String str; > |J) SimpleThread.java 
Y tests 
public void add (char c) {str = str + c;) > (J) SharingThreadsTest.java 
> |J) SimpleThreadTest.java 
erm String toString () (return str;) > mi JRE System Library |JavaSE-1.8] 


Threads.zip 


public class SharingThreadsTest { 
public static void main (String[] args) { 
SharedString soc = new SharedString(); 


new SharingThread("SharingAdda", soc, 'a').start(); 
new SharingThread("SharingAddb", soc, 'b').start(); 
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Sharing Thread Problem 


We want the output from this code to produce, typically: 


D 

bb 

bba 
bbab 
bbabb 
bbabba 
bbabbab 


bbabbaba 
bbabbabaa 
bbabbabaaa 


LO 
LO 
to 
EO 
BO 
LO 
to 


EO 
LO 
Lo 


SharingAddb 
SharingAddb 
SharingAdda 
SharingAddb 
SharingAddb 
SharingAdda 
SharingAddb 


extended 
extended 
extended 
extended 
extended 
extended 
extended 


oT TIN 
SI IMS 
Sering 
Sterne 
STEIN 
ora 
String 


Shared 
Shared 
Shared 
Shared 
Shared 
Shared 
Shared 


No more increments left SharingAddb 
Shared String extended by SharingAdda 
Shared String extended by SharingAdda 
Shared String extended by SharingAdda 
No more increments left SharingAdda 


TO DO: Your task is to code the class SharingThread extends Thread {} 
to provide this behaviour 
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Thread State Machine: an abstraction of the complete 
diagram 


new Thread() yield() 


Thread 


> 


Not Runnable 


New 


stop(), or 
runí() exits 


The start () method creates the system resources necessary to run the 
thread, schedules the thread to run, and calls the thread's run () method. 


The next state state is "Runnable" rather than "Running" because the 
thread might not actually be running when it 1s in this state. 
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Thread State Machine: an abstraction of the complete 
diagram 


new Thread() yield) 


æ Not Runnable 5 


stop(), or 
runí() exits 


A thread leaves the "Not Runnable" 
A thread enters the "Not Runnable" state when: state when a matching condition is met: 


*sleep() is called. *sleep() is completed. 


‘suspend () is called. ‘resume () is called 


«The thread uses its wait () method to wait «object owning the variable calls 


on a condition variable. notify() ornotifyAll() 


*The thread is blocking on I/O. "I/O completes 


SS 


Thread State Machine: an abstraction of the complete 
diagram 


new Thread() yield() 


New Thread Not Runnable 


stop(), or 
runí() exits 


A thread dies naturally when its run () method exits normally 


You can also kill a thread at any time by calling its stop () method 
QUESTION: What should happen if an exception occurs inside a thread? 


BEER 


Threads and Synchronization Issues 


Threads can share state (objects) 


This 1s very powerful, and makes for very efficient inter-thread 
communication 


However, it makes two kinds of errors possible: 
"thread interference, and 


«memory inconsistency. 


Java provides a synchronization "tool" in order to avoid these 
types of errors. 


Thread Interference 


Interference happens when two operations, running in different threads, but acting 
on the same data, interleave. This means that the two operations consist of 
multiple steps, and the sequences of steps overlap. Because they are 
unpredictable, thread interference bugs can be difficult to detect and fix. 


Consider a simple class called Counter 


class Counter 4 
private int c = 0; 
public void increment() {c++;} 


/* Multiple steps of c++ 
Retrieve the current value of c. 
Increment the retrieved value by 1. 
Store the incremented value back in c. 


WNE 


SL 
public ‘void decrenent(), ] 
Police imne valus O ECM co) 


) 


If a Counter object is referenced from multiple threads, interference between threads 
may give rise to unexpected behaviour. 


Memory inconsistency 
Consider the following example. 
int counter = 0; 
The counter field 1s shared between two threads, A and B. 
Suppose thread A increments counter: 
COUPE i 
Then, shortly afterwards, thread B prints out counter: 
oystem.out.prontlirmr(counter); 


If the two statements had been executed in the same thread, it would be safe to assume that the 
value printed out would be "1". 


But, in this example, the value printed out might well be "0", because there's no guarantee that 
thread A's change to counter will be visible to thread B — unless the programmer has 
established a happens-before relationship between these two statements. 


There are several actions that create happens-before relationships. 


The simplest technique/tool is to use synchronization 
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Synchronized methods, example: 


public class SynchronizedCounter 1 


private int € = 0; 

public synchronized void increment() {c++;} 
public synchronized void decrement() {c--;} 
public synchronized int value() {return c;] 


Two invocations of synchronized methods on the same object cannot interleave. 
When one thread is executing a synchronized method for an object, all other 
threads that invoke synchronized methods for the same object block (suspend 
execution) until the first thread 1s done with the object. 


When a synchronized method exits, it automatically establishes a happens-before 
relationship with any subsequent invocation of a synchronized method for the 
same object. This guarantees that changes to the state of the object are visible to 
all threads. 


Synchronization 15 effective for keeping systems safe, but can present problems 
with liveness 
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Java Constructors cannot be synchronized 


http://docs.oracle.com/javase/tutorial/essential/concurrency/ 
syncmeth.html 


Note that constructors cannot be synchronized — using the synchronized keyword with a constructor is a syntax error. 
Synchronizing constructors doesn't make sense, because only the thread that creates an object should have access to it 


while it is being constructed. 


Warning: When constructing an object that will be shared between threads, be very careful that a reference to the 
object does not "leak" prematurely. For example, suppose you want to maintain a List called instances 
containing every instance of class. You might be tempted to add the following line to your constructor: 


instances.add(this); 


But then other threads can use instances to access the object before construction of the object is complete. 
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